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For several years, WestEd’s Measure to Learn 
and Improve (MLI) project team has kept 
California state policy leaders informed 

about the statewide implementation of the 
California Academic Standards in English 
language arts and mathematics, by summariz- 
ing and disseminating results from the RAND 
Corporation's annual American Educator Panel 
(AEP) surveys of teachers and principals.' 
This brief summarizes recent results related to 
peer collaboration, data use, and continuous 


improvement. 


Peer collaborations for 
continuous improvement 


picture of an issue. Notably, these latter (less fre- 
quent) activities are traditionally thought of as 
important aspects of continuous improvement 
(Hough et al., 2017). Moreover, as also shown in 
the tables, California educators in different con- 
texts varied in the frequency of their reported 
engagement in these practices. For example, 
teachers and principals in elementary schools, 
and in schools with higher proportions of English 
learner students, reported engaging in these types 
of activities more frequently than their other 
peers, as did less-experienced educators. 


Principals’ data use practices 
and supports 


Educators work with their peers in various ways. 
The most frequent activities that California 
teachers and principals reported engaging in 
when working in collaborative teams (as shown 
in tables 1 and 2) were using data to make links 
between instruction and student outcomes; 
approaching an issue by looking at data; draw- 
ing conclusions based on data; and identifying 
actionable solutions based on those conclusions. 
Less commonly reported as team activities were 
discussing preconceived beliefs about an issue; 
revisiting predictions made in previous meetings; 
and identifying additional data to offer a clearer 


Compared to principals across the survey’s national 
sample, in the May 2018 survey, California princi- 
pals reported slightly less frequent review of data 
to help inform their decisions about programming 
and resource allocation, or their feedback to staff 
about instruction. The survey results also showed 
that California principals were slightly less likely 
than principals nationwide to report that the sup- 
port they received in using student and school data 
was “totally sufficient” (table 3).? 


The May 2018 survey asked principals to select 

the top two supports that would be most helpful 
in facilitating their use of student and school data 
to guide their decisions and/or their feedback to 
staff. The most common selections for California 
principals (see table 4) were resources for paid 
time to set aside for the principal/team to examine 
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Table 1. Percentage of California teachers reporting having engaged in various team 
activities at east monthly in 2017/18 


Total for Teachers Teachers Teachers Teachers 
F1| oy. with fewer with with 25% aida Maile) 223 
teacher Elemen- Second-_ than 10-plus or fewer than 25% 
respon- tary ary 10 years’ years’ EL stu- EL stu- 
dents teachers teachers experience experience dents dents 
percentage percentage percentage percentage percentage percentage percentage 
In our collaborative teams, we... (n= 492) (n=218) (n=251) (n=106) (CR 1-3-9) (n=306) (n=167) 
Identify actionable solutions 57 61 53 64 55 53 63 
based on our conclusions 
Predict possible student 
outcomes when we consider 57 62 54 66 55 54 65 
changes in practice 
Draw conclusions based on data 55 65 46 59 54 50 65 
Use data to make links between 
instruction and student 53 63 43 63 50 47 65 
outcomes 
Approach an issue by looking 51 65 42 61 50 47 64 
at data 
Discuss our preconceived beliefs 48 54 46 56 48 50 50 
about an issue 
D ; 
E Explore data by looking for a7 57 42 58 AG 46 54 
@ patterns and trends 
Oo 
= Identify questions that we will 44 52 38 56 42 Al 53 
a seek to answer using data 
2 Revisit predictions made in 43 47 42 53 42 44 46 
—- previous meetings 
ie 
) : ae 
9 Identify additional data to offer 41 50 36 50 40 39 50 
o a clearer picture of the issue 
Oo 
Wy) 
. Note: The subgroup N counts do not combine to match the total CA respondent count because, for a few individuals 
® (i.e., 5-20) there was not sufficient information to group them for that particular classification. 
: 
ie) 
S student data and use the data to guide decisions Conclusion 
> about practice (55 percent); professional devel- 
Ww . ee . 
g opment on data-driven decision making at [my] Continuous improvement is a widespread priority 
v school (44 percent); and support from a [school or in California today, with many school districts and 
S district] data staffer, consultant, or mentor skilled county offices of education dedicating time and 
2 in data analysis (44 percent). California principals’ resources to strengthening local data review and 
s reported need for support from data staff was inquiry practices. Such changes are likely to take 
5 more than 10 percentage points higher than in the time, however. Implementing effective continu- 
ic survey's national sample. ous improvement at scale requires not only new 


NO 
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Table 2. Percentage of California principals reporting having engaged in various team 
activities at east monthly in 2017/18 


Ja lived | oy=] Mm oda fated | of-) 
Total for Principals (o} mXel s (oYe) Ime) mXod Lele) | 
F1| ey. with fewer Principals enrolling enrolling 
principal Elemen- Sec- than with 5-plus 25% or more than 


g-¥4 Xe) 1 tary ondary 5 years’ years’ fewer EL 25% EL 

dents rey dlated| o-) Mmmm ol alates | of-] oMmm-> 4 eX-Val-1ilok-MaN->.4 ol-Va(-Valet- Med dU Le (ab dy students 

percentage percentage percentage percentage percentage percentage percentage 
Timed Tamexe) | f=] exe) e-)4hX- <-¥-111 1m Seem @ 7 Bet OL 0) NIN @ AO) 0) a Oy I-19) (n = 80) (hw te}-)) (n = 177) (Cm [e:)) 


Use data to make links 
between instruction and stu- 64 69 58 70 64 63 69 
dent outcomes 


Draw conclusions based on 


63 67 55 70 61 61 68 
data 
Approach an issue by looking 62 64 53 63 60 60 63 
at data 
Identify actionable solutions 59 61 58 58 61 59 62 
based on our conclusions 
Explore data by looking for 58 57 60 58 58 59 57 


patterns and trends 


Predict possible student 
outcomes when we consider 55 56 57 55 57 56 56 
changes in practice 


Identify questions that we will 


ontinuous Improvement 


ndc 


a 


saying about Data Use 


c 


previous meetings 


s 54 52 56 60 51 52 56 
seek to answer using data 
Identify additional data to 
offer a clearer picture of the 53 52 51 59 49 51 54 
issue 
Discuss our preconceived a7 45 55 AG 48 46 50 
beliefs about an issue 
Revisit predictions made in 44 a7 44 43 47 43 51 


Note: The subgroup N counts do not combine to match the total CA respondent count because, for a few individuals 
(i.e., 5-20), there was not sufficient information to group them for that particular classification. 


What California Educators Are 


mindsets, skills, and capacities among individuals, all influence these efforts (Gallagher et al., 2019). 
but also significant shifts in organizational norms, Thus, there is a great need for education organiza- 
roles, and relationships at various levels of the tions across California to learn by doing and to 
education system (Hough & Myung, 2019). In this share that learning, especially about continuous 
push for continuous improvement, context mat- improvement’s key enabling conditions. 


ters: Preexisting structures and processes, time for 
educator collaboration, and supportive leadership 


GN 
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Table 3. Data use practices and supports reported by principals for 2017/18 


Table 3A. [In 2017/18] how often did you personally look at data to help inform your decisions and/or 
feedback to staff about instruction, programming, or resource allocation? 


(or-Viicelanlt-M el-Vaet-til t-te l=) National sample percentage 
Frequency (n = 287) (n = 3287) 
Never 0.3 0.4 
A few times 18.1 13.3 
About monthly 35.0 33.0 
More than once a month 46.6 53.3 


Table 3B. During [2017/18], how adequate was the support you received in using student and school data to 
inform your decisions and/or feedback to staff? 


(ot-Vi ice) ailt-M el-Vaet-til t-te =) National sample percentage 
Frequency (n = 287) (n = 3287) 
Totally insufficient 8.0 4.5 
Somewhat insufficient 17.4 15.0 
Somewhat sufficient 57.3 57.7 
Totally sufficient 17.2 22.8 


Table 4. Types of data use supports sought by principals in May 2018 


aying about Data Use and Continuous Improvement 


S 


(or-Vitxey galt) National sample 


percentage percentage 
Data use support (101 0)) (CY e10)) 


Resources for paid time set aside for you and/or your distributed leader- 
ship team to examine student data and use the data to guide decisions 55.3 48.1 
about practice 


Professional development on data-driven decision making at your school 44.4 41.8 
Support from local data staff, consultant, or mentor skilled in data 441 31.7 
analysis i : 
Professional development on data-driven decision making outside 

21.0 16.6 
your school 
Your district’s encouragement for using data in decision making 7.8 10.3 
Formal coursework covering data-driven decision making 5.1 4.5 
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1 The RAND Corporation’s American Educator Panel 
(AEP) surveys were originally launched in 2014 and are 
administered several times a year in more than 20 states. 
To create the panels, RAND first sampled 2,300 U.S. pub- 
lic schools, stratifying for balance by grade span (primary, 
middle, high, and combined), school size, poverty status, 
population density, and geographic region. Educators in 
California and several other states were over-sampled 
to afford state-level representativeness. Educators who 
change schools remain on the panel, and new members are 
added periodically so the panel remains representative over 
time. For the May 2018 administration of the AEP surveys, 
492 of 879 California teachers (56 percent) and 300 of 1,056 
California principals (28 percent) responded. The aver- 
age margins of error for the results presented here thus 
generally range from +5-8 percentage points. Subgroup 
analyses/cross-tabulations were carried out using the raw/ 
unweighted counts of respondents, who were grouped by 
grade span (elementary/secondary), by years of experience 
(less than 10 years versus 10 years or more for teachers, and 
less than 5 years versus 5 years or more for principals), by 
subject area (English language arts/math teachers), and by 
the proportion of EL students they teach or oversee at their 
site. Only statistically significant subgroup differences are 
presented in this brief. 


2 California principals of schools enrolling more than 
25 percent English learner (EL) students more often 
reported that they “personally look at data to help inform 
decisions and/or feedback to staff about instruction, pro- 
gramming, or resource allocation” more often than once a 
month (55 percent versus 40 percent among principals of 
schools enrolling lower proportions of EL students). 
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